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ABSTRACT 

Louisiana's State-FUnded Compensatory/Remedial 
Program requires two different evaluations:' a study. of the statewide 
program and local evaluations conducted by the 66 public school 
systems involved in th<^ program. The State Education Agency (SEA) 
evaluation unit is responsible for (1) conducting the statewide 
evaluati<yi and (2) exercising quality assurance over, and providing 
technical assistance to, the local evaluations. State Board of 
Education policy requires that both evaluations apply the Standards 
for Evaluations of Educational Programs, Projects, and Materials. 
This paper is written from the point of vie^I^f evaluation management 
and discusses the^accountability uses of the processes and 
information for statewide and local evaluations. It identifies the 
organization and management relations developed to carry out the 
evaluations and discusses the issues arising in implementing 
evaluations that affect more than a single program or organizational 
unit. The issues discussed include maintaining the legitimacy of the 
evaluations and other SEA efforts, balancing the needs of other 
programs, using the evaluation information, balancing the dual role 
of the SEA evaluation unit, and assuring quality in the evaluation . 
(Author/PN) 
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INTRODUCTION 

This paper Js written from the perspective of an SEA evaluation unit with a 
dual role in the evaluation of the Louisiana State-Funded Compensatory/ Remedial 
Program evaluation. The Bureau of Evaluation within the Office of Research and 
Development is responsible for conducting the State program evaluation and for 
managing the quality control of local evaluations of the program. The preceding 
papers in this symposium have discussed additional components of Louisiana's 
competency-based education effort. Tl^ls presentation is limited to the evaluation 
of the State-Funded Compensatory/ Remedial Program but notes other State 
Education Agency (SEA) programs and units that were involved in the program or 
its evaluation. The objective is to identify the accountability uses of program 
evaluation information when a new and comprehensive program effort is initiated 
and to discuss the issues that can arise in the collection and use of such 
information. f 

"Accountability" is used here in a broad sense. It includes the demonstratiorb 
of whether or not a program is a) meeting the objectives for which it vyas designed 
and b) carried out in agreement with the legislation and regulations governing its 
activities. 

DESCRIPTION OF THE EVALUATIONS 

Louisiana's State-Funded Compensatory/Remedial Program requires that each 
public school student addressing the State's rpinimum standards in language arts 
and mathematics who fails to achieve the performance criteria established by the 
Board of Elementary and Secondary Education on the Stat^ Basic Skills Test (BST) 
be provided with remedial instruction in these skills. The program is supported 
entirely by State funds allocated to the local school systems on the basis of the 
number of qualifying students per subject area. The BST was initiated in the 
spring of 1982 for gr^de 2 students. A grade level wHI be added each year until 



all grades, 2 through 12, are tested annually in 1992. In the first administration 
of the BST, 6,243 students tested in grade 2 qualified for the State-Funded 
Compensatory /Remedial Program. 

The enabling legislation for the program, Louisiana R.S. 17:394-400 , places 
specific reporting requirements on the State Superintendent of Education that 
comprise the justification for a State-level evaluation. The Superintendent is 
required to report annually to the legislature and the State Board on the effect of 
the program, the number of students served, the cost, and which programs are 
most effective. The legislation also requires local evaluations to be conducted by 
the school systems conducting compensatory/ remedial programs. 

The State evaluation is conducted by the SEA Bureau of Evaluation. The 
program regulations, developed by the SEA and approved by the State Board, 
require that all local school systems participate in this State evaluation. The 
Bureau of Evaluation prepared a formal design for this evaluation, which was 
negotiated with all SEA units involved in the program and accepted by the Bureau 
of Elementary Education. This latter Bureau administers the State-Funded 
Compensatory /Remedial Program. 

The local evaluations are conducted by the local school systems and submitted 
to the SEA for presentation to the State Board. However, the Bureau of 
J^valuation is involved in these local evaluations through several of its other 
functions. First, as an SEA unit it provides technical assistance in developing 
program evaluation skills. Second, the Bureau of Evaluation is responsible for 
carrying out the State Board regulations t+iat require such evaluations to be 
conducted by an SEA-certified evaluator and to apply the standards for educational 
evaluations adopted by the State Board. 
^ 

*These a'/ e the Standards for Evaluations of Educational Programs, Projects, and 
Materials developed by the Joint Committee on Standards for Educational Evaluation 
In 1981. 

i 



The Bureau of Evaluation developed requirements for local evaluations that 
were included in the State-Funded Compensatory/ Remedial Program regulations, 
reviewed the local evaluation plans, and will review the final reports for 
application of the Standards. Figure 1 gives a brief descripftlon of these State and 
loc^l ^valuations. It shows the requirement for each, who is responsible for its 
cohduct, and who receives the evaluation report. It also gives a brief listing of 
the specified content, although neither the State nor the local evaluation is limited 
to the areas shown on the figure. 

Purposes of the Evaluation 

The state evaluation serves as the major accountability structure for the 
State-Funded Compensatory/ Remedial Program. One major purpose is to provide 
policy makers with information about the success of the program in removing skills 
deficiencies among qualifying students. A second major accountability function is 
to document compliance with legislation and regulations on the part of the SEA, 
which administers the program, and the local school systems that implement it. 

The evaluation is also intended to provide information that can be used by 
program planners to improve the quality of the program. Both the SEA and the 
local school systems will receive reports on the characteristics of relatively more 
effective programs, strategies school systems have developed in meeting the needs 
of local situations, and participants' suggestions for improving the structure of the 
program. 

Instructional improvement is the chief purpose of the local evaluations. Each 
on^ is different, but they all describe and document three major components: 
student achievement, coordination of compensatory/ remedial serylces with other 
elements of the student's education, and the Instructional program. The 
flexibility In local evaluations also allows them to meet purposes defined by the 
Individual school systems. 
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REQUIRED BY: 



CONDUCTED BY: SPECIFIED CONTENT: RECEIVED BY: 



STATE EVALUATION • Legislation Enabling . • SEA Evaluation 

Program Unit 
• State Program 

Regulations (Local 
Participation) 



• Number of Students • State Legislature 

Served - • State Board 

• Effect of Program 

• Cost of Program 

• Identification of 

Most Effective 
Programs 



LOCAL EVALUATIONS • Legislation • Local School • Effect of Program • State Board 

(Program) Enabling Program Systems • Coordination with • SEA 

• State Program Other Local Programs 

Regulations • Instruction (Methods 

and Materials) , 



LOCAL EVALUATIONS • State Board Local School • Conducted by Certified • State Board 

(Quality Assurance) . Regulations Systems Evaluator • SEA 

• Application of 
Standards for 
Evaluations 



FIGURE 1. OUTLINE OF STATE-FUNDED COMPENSATpRY/REMEDIAL PROGRAM EVALUATIONS 
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The local evaluations serve several accountability functions. First, they give 
local audiences information about the success of the programs they report. 
Second, they provide local school systems with documentation should their findings 
^ disagree with the State evaluation. Third, these evaluations are a formal means 
through which school systems can request changes in the regulations governing 
the program. 

The quality assurance aspect of the local evaluations is designed to improve 
educational program evaluation. They are a means for ensuring that evaluations 
are conducted by certified evaluators and apply the State Board-adopted 
standards. 

COORDINATION 

Practical as well as procedural constraints required that the evaluations be 
coordinated with the local school systems and other .SEA units in the planning, 
implementing, and reporting stages. This was due in part to the multi-component 
nature of the evaluations: although the State and local evaluations were 
independent, they did involve the same students participating in the same 
program. Coordination was also needed because other SEA programs w^re directly 
or indirectly involved in the State-Funded Compensatory/Remedial Program and 
because multiple data sources were used for the State evaluation. 

Coordination of State and Local Evaluations 

The State and local evaluations were independent in several ways. 

1. The State evaluation was conducted and reported independently; it 
V did not consist of a compilation of local evaluations or local data. 

\ ♦ 

2. Local school systems developed their own designs, implementation, 

and reporting for their evaluations. ^ 
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3. Although the Bureau of Evaluation reviewed them, the local 
evaluation plans were formally approved as part of each system's 
Pupil Progression Plan by the State Board. ^ i 

Coordination of the State and local evaluations - was reflected in several 
other aspects. 

1. The Bureau of Evaluation developed the requirements for the local 
evaluations, including the specified content shown on Figure 1. 

2. Local school systems were encouraged to use any information they 
collected for the State evaluation in their local evaluations. 

3. Local school system sta/f acted as data cof lectors for the State 
evaluation. *• 

4. The Bureau of Evaluation provided technical assistance upon 
request and offered workshops on developing local designs to meet 
the evaluation requirements, as well as two workshops on 
evaluation that used the State-Funded Compensatory/ Remedial 
Program as a focus. 

Coordination of State Evaluation and Other Programs 

As an in-house evaluation unit, the Bureau of Evaluation routinely maintains 

the Integrity of its products by submitting a forn^ evaluation design and all 

reports to the Associate Superintendent for Research and Development and the 

State Superintendent of Education as well as to the staff of the program being 

evaluated. The State-Funded Compensatory/Remedial Program evaluation required 

additional coordination in its planning and implementation. Some of the SEA units 

with major involvement are listed below. 

1. The Bureau of Elementary Education. This was the unit 
responsible for administering the State-Funded 
Compensatory/ Remedial program. Several major points of 
coordination were: 

• Developing the regulation^ that included both program and 
evaluation requirements, and 

• Development and use of forms that were both a part of 
program administration and a source of evaluation data. 

2. The Bureau of Accountability. The Bureau that managed the State 
0ST program provided: 

/ 

• Access to BST data for students who qualified for 
compensatory/ remedial instruction (this is treated as secure 
data by the SEA), 

J 
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• Generation of customized student report^ or records used to 
collect evaluation data, and 

• BST test specifications that - were used to develop an 
evaluation test for the program. 

3. The Office of Special Education. This group provided information 
about regulations affecting those students who qualified for both 
the State-Funded Compensatory/ Remedial Program and special 
education services. 

4. The Office of Federal Programs. This unit similarly provided 
information about regulations concerning students who qualified for 
the State program and Chapter I services. 

5 . Office of the Superintendent. In addition to the specified 
information required by the Superintendent this office was 
concerned with several other SEA efforts associated with the 
State-Funded Compensatory/ Remedial Program evaluation. Two of 
the major ones were: 

• The relationship between BST performance and grade 
placement among students qualifying for the program. The 
BST was required to serve as the principal (but not the 
only) criterion for promotion in the Pupil Progression Plan 
developed by each local school system. 

• The Superintendent's commitment to reduce the amount of 
paperwork required by the SEA from local school systems. 
All reporting required in the administration and evaluation of 
the State-Funded Compensatory /Remedial program was closely 
scrutinized and weighad before it was approved. 

AUDIENCES AND INFORMATION NEEDS 

Figure 2 outlines the major audiences and their primary evaluation information 
needs for both the State and local evaluations. The chart is limited to those 
audiences and types of information with an immediate impact upon the scope and 
form of the program. As a result, it does not include some important audiences, 
such as parents, whose decisions would have a more indirect influence upon the 
future of compensatory/ remedial education. The planned information needs, those 
that were drawn from legislation and regulations and included in the formal 
evaluation design, are indicated in capital letters. Secondary information needs 
that emerged during the conduct of the evaluations are shown In lower case 
letters. The figure is further subdivided Into the *State and local evaluations, and 
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FIGURE 7. MAJOR AUDIENCES AND INFORMATION NEEDS 



the heed.s associated with prografli^ objectives and program implementation within 

these, ^he audiences and information needs are treated briefly in ,this section 

because they are given full discussion later. * * 

The information needs of*the State Legislature were all considered planned (as 

defined* in Figure 1)ih that the^ were specified in the State-Funded 

Compensatory/Remedial Program's enabling legislation. The Board of Elementary 

1 . ^ . 

and Secondary Education had some, secondary needs through its role in approving 

the program regulations and program plans in the Pupil Progression Plans, and 

through its regulations concerning^ducational evaluations. The Superintendent of 

Education and the SEA administrative uni\ were concerned about the effect of the 

jDrogram on student mastery of the State basic skills as ^ell as local, compliance 

with the law and the program regulations the SEA was charged with implementing. 

These groups were also^concerned with the^effects of the program regulations on 

local school systems because of the need to protect ongoing working relationships 

and to provide technical assistance when needed. 

I 

Three other SEA programs are included in Figure 2. These became involved 
in the. program or /i^ evaluation as it became obvious that the program had some 
impact on their operations. These programs had not been specified as audiences 
in the Evaluation design. ' 

The B^TN qualified students for the State-Funded Compensatory /Remedial 
Program and was considered the ultimate measure of the program's effect on skill 
mastery apd future school success. This provided the Bureau of Accountability 
With a vested interest in the State evaluation. The irfVo^^ment of Chapter I came 
about through a request from local school systems' that^^ Chapter I teachers be 
allowed to provide compensatory/ remedial instruction to students who quatified for 
both programs. Special Education was also concerned about the effects of multiple 
participation and requests that special education teachers be permitted to provide 
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compensatory/ remediaj services, but had an additional interest. The BST was to 
be administered only. to students attempting the State minimum standards. Hence, 
special education students who were in an alternative to regular placement and by 
definition not addressing the minimum standards were not tested with the BST* and 
did not qualify for the State-Funded Compensatory/ Remedial Program. However, 
some students were classified as special education, alternative to regular 
placement, after taking the BST and qualifying for compensatory/ remedial services. 
The Bureau of Elementary Education ruled that local school systems did not have 
to provide compensatory/ remedial instruction to these students. The Office of 
Special Education wanted to ensure that all special education students received the 
full range of services for which they were eligible. 

Local schooh systems were involved with the State evaluation as it reflected 
their compliance with the State regulations. Budget expenditures and the number 
of students served were the only information reported by school system in the 
State evaluation report. The evaluation design interpreted the requirement to 
identify the mpst effective programs as the need to measure the relative effect of 
broad program variables such as scheduling (in-class versus pull-out versus 
extended day) of program services. As a result, identifying the most effective 
program did not involve ranking or otherwise comparing school systems. The 
requirements for the local evaluations meant that they had to provide audiences 
within the school system with information about student skills mastery. The local 
evaluation also gave the school systems the opportunity to weigh the success and 
difficulties encountered in implementing the State program regulations. There were 
doubtless other information needs met by the local evaluations, but these cannot be 
specified here since each evaluation was different. 
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ISSUES IN MANAGING THE EVALUATIONS 



The management issues that arose in the State and local evaluations were 
primarily due to the interaction of the coordination and information needs already 
discussed. Most of these issues involved the secondary information needs. It is 
assumed in this paper that many of these issues would be generic to any large, 
multi-component evaluation of a comprehensive program in its initial/ year. 



Maintaining Legitimacy 

The State evaluation frequently relied on data provided by other SEA units 
and originally collected for purposes other than the evaluation. This added to the 
quality of the evaluation, since the accuracy and usefulness of the information was 
increased by the process of reconciling data from all of the different sources. 
However, Jt also raised the potential problems of using information out of context 
or changing its interpretation. Very few findings could be presented or explained 
simply. A few instances of these difficulties are given below. 



1. Maintaining credibility of the State testing program. The BST was 
initiated jn 1982 after several years of careful work to tensure its 
technical quality and professional acceptance. For this reason it 
could not be used as an evaluation instrument, since that would 
raise problems of test security and possible over-familiarity among 
qualifying students. SEA use of a different test for evaluation 
purposes would have to avoid comparison with the^ BST since the 
two instruments, and their purposes, differed. 

2. Establishing credibility of the evaluation test. The evaluation was j 
required to provide information about student mastery of the State ^ 
minimum standards. There was no commercially available test that , 
measured all of these, and the Bureau of Evaluation was forced to 
develop its own test through an item banking service. ' Developing 

a credible measure without making unwarranted technical claims 
was an issue. 

3. "fechnical distinctions. The program regulations required 
remediation of only deficient skills for each student, and defined 
these as skills on which the student answered fewer than three of 



the four relevant - items correctly on the BST. Because of 
technical considerations of item reliability, the Bureau of 
Accountability was very careful to avoid distingui^ing ^ between 
"deficient" and "nondeficient" skills in such a manp^. This was a 
difficult point to make in reporting. ^ 

Complexity -in interpreting findings. The BST's role in promotion 
was an example of this. The test was to serve as the principal, 
but not sole, criterion in the local Pupil Promotion Plans that 
determined the procedures for promoting or retaining students. 
The simplified public interpretation of this was something like "the 
BST would step social promotion." Evaluation data showed that 
students who qualified for compensatory /remedial services were 
about as likely to be promoted to grade 3 as retained in grade 2. 
This was because school systems were more likely to promote the 
qualifying students who had less extensive deficits and because 
many Pupil Progressions Plans also considered factors such as the 
number of years' retention in one grade in making promotion 
decisions. Such findings were difficult to report accurately and 
understandably in a manner that qHlFhot' damage other programs. 



Balancing Needs of Other Programs 

Coordination required a balance between activities needed in order to carry 
out the State evaluation and to further other SEA efforts. A single issue in'^this 
area is discussed here: weighing data neieds and the burden on local school 
systems. This affected the evaluation in two instances. 



1 . The State Board was concerned about the extent of student 
testing and required the Bureau of Evaluation to test only a 
sample of compensatory/ remedial students. While the resulting 
sample was technically adequate for the State as a whole, it was 
not large enough in any single school system to allow that system 
to use the compensatory education evaluation test as a major 
measure of student skill mastery. 

2. The Bureau of Evaluation developed a form for th6 Bureau of 
Elementary Education to use in its monitoring site visits. This was 
to have the dual purpose of providing compliance information for 
the program administration and furnishing evaluation data. The 
original pljan was to have each school system verify and complete 
information and return the completed form to the SEA before the 
site visit. These forms would then provide the sampling frame for 
the evaluation's data collection and required information for the 
Interim evaluation report that was due before all of the monitoring 
visits would be completed. "^However, to reduce paperwork, school 
systems were told npt to complete the form in advance, but to use 
It as a checklist of what would be covered during the mbnitoring. 
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As a result, it could not be used by the Bureau of Evaluation In 
the manner planned. The evaluation relied on older reports, * 
verified by telephone with the 66 school systems, for sampling and 
reporting purposes. 



Use of Evaluation Information 

The secondary Information needs were those that developed during the 
Implementation of the program. By definition, these were not included in the 
evaluation design. They also involved. In some cases, other SEA programs that 
did not have a clear, preplanned role in the State-Funded Compensatory/ Remedial 



1. Undefined responsibility. At the request of several local school 
systems, the SEA program' administrators approached the SEA 
Chapter I administration to request permission for Chapter I 
teachers to provide compensatory/ remedial services to students who 
participated In both programs. Chapter I agreed that this did not 

N constitute supplant and the Bureau of Elementary Education worked 
with Chapter I to develop proceduJ'es through 'which local Chapter 
I programs could provide remediation and be reimbursed from 
State-Funded Compensatory/ Remedial program funds. However, 
R.S. 17:391-^00 • specifically restricted the program from 
supplanting any other local. State, or federal* remedial funds. The 
evaluator felt strongly that the working relationship with Chapter I 
needed to be more ^ fully examined to determine if* 
Compensatory/ Remedial Program funds were supplanting Chapter I 
moneys. However, the program administration felt comfortable with 
|he assurance that Chapter I fUnds were not supplanting those of 
the State-Funded Compensatory/ Remedial Program and did not 
pursue the issue further. There was no other group that was^ 
appropriate for the evaluation to approach to which the question 
could be taken. 

2. Lack of working relationships. It has been noted that some 
students who qualified for the program on the basis of their BST 
scores were subsequently classified as special ediication, 
alternative to regular placement^ and not provided with 
compensatory/ remedial services. This decision was made by the 
SEA program administration. In this case there was a legitimate 
channel through which the Bureau of Evaluation could refer the 
information to the Office of Special Education. One of the 
Bureau's positions was a staff person who served as a full-time 
liaison for policy and procedural issues between the Office of 
Special Education and the State basic skills testing program. This 
eValuator, together with an evaluator assigned to the State-Funded 
Compensatory/ Remedial Program, prepared a report on the 
alternative to regular placement students and submitted it to the 
Bureau of Elementary EducatlqrL, and the Office of Special 
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between these two units for decisions affecting students in the 
Compensatory/ Remedial Program, and the issue will not be resolved 
in time for these students to be provided compensatory/ remedial 
services (if that is the ultimate decision) during the 1982-83 school 
year. 

Dual Role of the Evaluation Unit 

The Bureau of Evaluation was responsible for carrying out the State 
ev9luation and maintaining quality assurance for the local program evaluations. 
In these roles the Bureau managed local participation In the State evaluation, 
implemented the State Board regulations for program evaluations, and provided 
technical assistance to local school systems. Both the State-Funded 
Compensatory/ Remedial Program evaluations and the quality assurance efforts were 
new efforts, and they were at times confusing t6 local school system staff. 

1. Confusion between technical assistance and regulations. The same 
SEA evaluation unit, and frequently the same staff, were 
associated with technical assistance and Implementing the 
requirements for local evaluations. The Bureau attempted to walk 
a fine line between these two roles. For example. It provided 
examples of data collection Instruments as well as workshops and 
Individual help In developing such instruments, but refused to 
develop standardized forms.^ that could be used by local school 
systems. This could caUee some confusion. In November 1982, 
the Bureau and a group of large city evaluators offered a 
workshop on evaluation that used the Compensatory/ Remedial 
Program as a focus. The two-day workshop was a comprehensive 
treatment of program evaluation. Some participants left with the 
mistaken Idea that they were required to conduct an evaluation as 
thorough as the one that had been presented as a teaching model. 
The confusion was corrected by a letter from the SEA stressing 
that the local evaluations needed to follow only the plans 
presented in the local Pupil Progression Plans. 

2. Confusion between program evaluation and administration. The 
evaluation unit worked closely with the program administration In 
developing administrative regulations and ways In which 
Instrumentation could provide data to both groups. This made It 
easy for local school system staff to become confused about which 
SEA staff persons could make administrative decisions. They 
would call the evaluation unit, for example, with questions about 
which students were to be served or what kinds of expenditures 
were allowable. Particularly In the early months of the program, 
1i was necessary to stress the differences between "evaluation" 
'.nd "program" questions. The evaluation unit staff had to remain 
very cautious about making Informal remarks that could be 
misconstrued as official SEA opinions and procedures. 
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Quality Assurance In Mixed Data Sources 

The State- Funded Compensatory /Remedial Program only Involved some 6,000 
students. However, It operated In all of the State's 66 public school systems and 
required three separate general reports (summer school. Interim spring data for 
the legislature, and end of regular year program) as well as several subsidiary 
reports. The data for these reports came from a variety of sources, and 
frequently the same Information was presented In more than a single report. In 
the latter case all of the data had to be updated and reconciled with earlier 
findings. This Is a common problem In jny longitudinal study, but one that Is 
compounded when data are drawn from different sources. 
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1. Reconciling different data sources. As an example, figures on the 
number of qualifying students were Initially drawn from the 
spring, 1982, BST tapes. These reflected the schools In which 
the students were tested. These figures were later modified as 
some children were disqualified because they were special education 
students who should not have been tested and others were 
"requallfled" as their disqualification status was appealed. Local 
school systems were asked to correct this qualification data In 
October, 1983. The Bureau of Evaluation had to track each 
student In these data who had transferred to* another school In the 
system, moved, or been classified as special education, alternative 
to regular placement. Tbe numbers of students qualifying for, 
and served by, the program were again reported In the Interim 
spring, 1 983 , ' report. At that point, when BST figures, local 
school system reports, and Bureau of blementary Education budget 
allocations were reconciled, ^3 of the Initial 6,2^3 students could 
not be accounted for In reporting. FIscaT Information was almost 
equally difficult to reconcile. 

2. Quality of data. Because of the size of the evaluation, local school 
systems acted as data collectors In administering evaluation tests 
and dtiJtrlbutIng survey Instruments to teachers. Some student 
data were missing from the tests, as well as from the Student 
Profile Forms maintained for each participating student. And, 
while there Is no Indication that the evaluation tests were used 
improperly, the evaluation cannot guarantee that they ^were 
administered correctly or that they remain rSecure. This will 
remain a potential problem In the State evaluation. 

CONCLUSIONS 

The fssues that have been discussed In this paper are ones that occurred In ^ 
the first year of Louisiana's State-Funded Compensatory/ Remedial Program ^ 
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evaluation. Similar problems could arise In any evaluation that Is as large and 
closely integrated with other SEA programs and activities as this one, particularly 
In the Initial year of a program. It would be a mistake to ignore the benefits of 
^ such large (and occasionally frustrating and labor-consuming) evaluations. 

The audiences wanted the Information and, except for the few Instances 
noted here, used It. This Is extremely gratifying to any evaluator. After 
hearing the summer school report, the State Board requested an additional report 
on special education students who had participated in the summer school program. 
Both the Bureau of Accountability and the Bureau of Elementary Education 
routinely Include evaluation staff In their presentations when the State-Funded 
Compensatory/Remedial Program Is discussed, and all of the evaluation findings 
are presented to the State Superintendent of Education's cabinet. 

Both the State and local evaluations have proved an excellent means for 
Increasing local sthool system staff skills In program evaluation. Good 
cooperative working relationships have been established between the SEA and the 
local systems. Requests for workshops and technical assistance have Increasejd, 
and group coaferences are well attended. More than 100 local evaluators and 
program administrators took part In the November, 1982, evaluator training. 
Some school systems allocated part of their State-Funded Compensatory/ Remedial 
Program money to program evaluation. Tests and survey Instruments were 
administered and returned In time; the local school systems were conscientious 
about administering them, and returned comments about th6 quality of the 
Instruments. 

In short, evaluations that Involve programs and Individuals outside the ^ 
evaluation unit become complex. The complication Is Increased when other SEA 
programs and eff6rts beyond that being evaluated enter In. However, there are 
benefits that probably outweigh the difficulties and that could not be gained 
through other means. 



ABSTRACT 



ACCOUNTABILITY USES OF A STATEWIDE COMPENSATORY 
EDUCATION PROGRAM EVALUATION 



' Louisiana's State-Funded Compensatory/ Remedial Program requires two 
different evaluations: a study of the statewide program and local 
evaluations conducted by the 66 public school systems involved in the 
program. The SEA evaluation unit is responsible for 1) conducting 
the statewide evaluation and 2) exercising quality assurance over, 
and providing technical assistance to, 'the Ipcal evaluations. State 
Board of Education policy requires that both evaluations apply the 
Standards for Evaluations of Educational Programs, Projects, and 
Materials. This paper is written from, the point of view of evaluation 
management and discusses the accountability uses of the processes 
and information for statewide and local evaluations. It identifies the 
organization and management relations developed to carry out the 
evaluations and discusses the issues arising in implementing 
evaluations that affect more thaa a single program or organizational 
unit. The issues discussed include maintaining the legitimacy of the 
evaluations and other SEA efforts, balancing the needs of other 
programs, using the evaluation information, balancing the dual role of 
the SEA evaluation unit, and assuring quality in the evaluation. 



inis puDiic document was published at a cost of $1.09 per copy by the StaU 
r Department of Educatiorl, P.O. Box ^^06^, Baton Rouge, LA 70804, to provide 
leadership for the continuous development, coordination, and improvement o1 . 
education on a statewide basis under authority of Louisiana R.S. 17:21. This 
material was printed in accordance with the standards for printing by state ' 
agencies estab lished purs uant to R.S. 43:31. ^ 
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